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Abstract. - A controversial issue in spin glass theory is whether mean field correctly describes 
3-dimensional spin glasses. If it does, how can replica symmetry breaking arise in terms of spin 
clusters in Euclidean space? Here we argue that there exist system-size low energy excitations 
that are "sponge- like" , generating multiple valleys separated by diverging energy barriers. The 
droplet model should be valid for length scales smaller than the size of the system {9 > 0), but 
nevertheless there can be system-size excitations of constant energy without destroying the spin 
glass phase. The picture we propose then combines droplet-like behavior at finite length scales 
with a potentially mean field behavior at the system-size scale. 



Introduction. - The solution of the Sherrington-Kirkpatrick mean field model of spin glasses 
shows that its equilibrium states are organised in a hierarchy associated with continuous replica 
symmetry breaking (RSB) A working paradigm for some years has been that this type 
of replica symmetry breaking also occurs in finite dimensional spin glasses above the lower 
critical dimension (2 < d; < 3); we will call this school of thought the mean field picture. The 
question of whether this paradigm is correct is still the subject of an active debate (see [|] and 
references therein). 

The mean field hierarchical organisation of states corresponds to valleys within valleys ... 
within valleys. Though such a structure is appealing to many, it seems to us necessary to 
describe how it can possibly arise for spins lying in Euclidean space. As an example, consider 
the many nearly degenerate ground states predicted by mean field; what is the nature of 
the clusters of spins that flip when going from one such state to another? It is not clear a 
priori that mean field has much predictive power here for the following reason. In any finite 
dimension, there are clusters whose surface to volume ratio is arbitrarily small. However 
this kind of object does not arise in models without geometry such as the (infinite range) 
Sherrington-Kirkpatrick model or mean field diluted models (such as the Viana-Bray model); 
any cluster in those models has a surface growing essentially as fast as its volume. This key 
difference is very important in spin glass models having up-down symmetry: when flipping a 
cluster, the change in energy comes from the surface only, but the change in quantities like the 
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overlap goes as the volume of the cluster. Another reason for insisting on finding a geometrical 
(sometimes called "real space" ) picture is that the dynamics of a real spin glass is local in space, 
leading to coherence effects that build up from small to large length scales. Realistic theories 
of spin glasses should then allow for these scales by incorporating the Euclidean geometry in 
which the spins are embedded. 

Spin clusters in Euclidean space have generated much interest since the early 80 's and 
have been studied in detail by Fisher and Huse |^ . These authors focused on understanding 
the properties of low lying excitations above the ground state, and their objects of study were 
localised compact clusters of spins (droplets). However, their goal was not to come up with a 
picture compatible with RSB; on the contrary, their conclusions are in direct conflict with the 
mean field picture. Unfortunately, there have been very few other works based on geometrical 
points of view. The possibility that droplets may be fractal rather than compact has been 
considered several times ^ and has gained renewed interest in the last few years In 
our work, we want to deepen the geometrical point of view and provide a coherent picture of 
valleys in the energy landscape of finite dimensional spin glasses. (All of the discussion that 
follows concerns energies; the temperature is zero.) 

We hope to convince the reader that appropriately constructed clusters of spins that are 
neither compact nor localised (i) have low energies, and (ii) are separated by energy barriers 
that diverge in the thermodynamic limit. These clusters occur on the size of the whole system 
which is assumed to be finite but arbitrarily large, so we call them system-size clusters. From 
the "spongy" nature of these clusters we can see how the spin glass stiffness exponent 9 can 
be positive in spite of the possible presence of system-size excitations of energy 0(1). Within 
our picture, the droplet model is expected to be valid at finite length scales (corresponding to 
properties within one valley) while a different picture, possibly mean-field-like, may be valid 
at the scale of the whole system. (The two scales of validity of course do not overlap.) We 
will provide several plausibility arguments for this kind of a mixed picture. No numerical 
evidence will be presented here, rather we will ask the reader to imagine what happens when 
one searches for low lying states; we believe that this point of view can uncover the essential 
qualitative properties of the energy landscape. 

9 exponents in the droplet and scaling pictures. - For definiteness, we consider the Edwards- 
Anderson model on an L X L X L cubic lattice, but our reasoning can be applied to any short 
range spin glass model in dimension d > 3. The Hamiltonian has nearest neighbor couplings 
and no external field: 



The couplings Jij are independent random variables with a symmetric distribution about 0. 
For simplicity, we take the Jij to be continuous random variables so that generically the ground 
state is non-degenerate in any finite volume. In all that follows, we assume the ground state 
to be given and investigate the low energy excitations above the ground state. 

Fisher and Huse Q define a droplet as a cluster having a characteristic size, containing a 
given site, and having the lowest possible energy if it is flipped. Because of the locality of the 
Hamiltonian, it is enough to consider droplets that are connected in the sense that their spins 
are within the range of the interaction couplings. Fisher and Huse then argue that droplets of 
characteristic radius r have energies that scale as r^ . Implicitly, their construction considers 
r given while the lattice size L —> oo; only after having reached the infinite volume limit 
does one let r grow. It is also possible to consider L and r going to infinity simultaneously. 
This is precisely what is done when one measures the exponent 9 by comparing periodic 
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and anti-periodic boundary conditions |lC|, This way of imposing boundary conditions 
introduces a domain wall that sphts the system into a "left" and a "right" part; one expects 
the characteristic energy of such a domain wall to scale as L^, matching onto the droplet 
scaling law. Clearly it is best to distinguish these two methods and to keep in mind that there 
are two exponents: the first, 6i {I for local), associated with scales much smaller than the size 
of the system; the second, ^^idj associated with the introduction of a domain wall that splits 
the system into a left and a right part. 

Is 9i — Odw'^ One might fear that a global object such as a domain wall spanning the width 
of the system will be sensitive to the shape of the box used or to the way one introduces the 
domain wall jl^ . But Fisher and Huse 1^ have argued that droplets should have similar local 
surface properties to those of an interface formed with the periodic-anti-periodic boundary 
conditions. In that case, one expects the droplet scaling E{r) w r^' to extend to sizes r fa L, 
leading to 9i = ddw But one need not and should not conclude that the lowest energy 
excitations on the length scale of L obey this energy scaling if their nature is different from 
domain walls. Our claim is that in spin glasses there do exist other kinds of excitations on the 
scale of the whole system that do not resemble domain walls but that instead resemble sponges 
(they have a non-zero surface to volume ratio and are topologically highly non-trivial). We 
expect these excitations to have energies smaller than 0(L^'). Then extrapolating the droplet 
picture from finite size droplets to excitations spanning the whole system misses some of the 
most important physics of low lying states. It is thus necessary to distinguish the local exponent 
9i that describes finite size excitations sX L = oo from a global exponent, hereafter called 
that describes the energy scaling of the lowest energy system-size excitations. Mathematically, 
this simply means that the limit i, r — > cx3 depends on the ratio r/L. We have previously 
presented evidence for this kind of dependence in a quite different disordered system, 
the minimum matching problem. That model has droplet-like excitations, allowing one to 
introduce an exponent 9i which satisfies 9i > 0; one can also numerically measure 9g and one 
finds 9g w —0.5. In the rest of this article, we will argue that this type of subtlety for global 
properties also arises in spin glasses so that the distinction between 9i and 9g is crucial. Note 
that, as pointed out by Fisher and Huse, 0; > is a necessary condition for the existence of 
a spin glass phase at finite temperature; however, no such condition applies to 9g. In fact, 
within the mean field picture, there are system-size excitations of constant energy, so 9g — 0; 
the presence of such excitations does not preclude a spin glass phase. 

Compact versus non-compact droplets. - Within the Fisher-Huse picture, the surface of a 
droplet is rough in analogy with that of an interface in a disordered medium. Such a behavior 
is found for the surfaces created by comparing periodic and anti-periodic boundary conditions. 
The standard picture is thus that droplets are compact (i.e., their surface to volume ratio goes 
to zero as their volume grows) with a rough surface having small overhangs and handles. (To 
be specific, we identify the surface of a cluster with the set of bonds connecting the cluster to 
its complement.) 

A second scenario has been suggested [|| ||, namely that droplets are not compact but 
fractal. Here, we would like to consider a third scenario. It seems to us that there may be a 
fixed length scale below which droplets are compact, but beyond which their surface to volume 
ratio no longer decreases because handles proliferate and penetrate into their insidcs. Such 
objects can best be thought of as sponges: these are homogeneous at a coarse-grained level, 
have handles everywhere, and are multi-connected. Because of this property, the scenario we 
present here can be relevant only in dimensions d > 3. The essential feature of sponges is that 
both their surface and their volume grow proportionally to their "diameter" to the power d. 
This is to be contrasted with what happens in the two other scenarios. In the case of compact 
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Fisher-Huse droplets, the surface grows as a power which is smaller than d. In the case of 
fractal droplets, it is the volume that grows as a smaller power. 

In both the fractal and sponge scenarios, ddw ^ Oi and 6dw ^ Og because domain walls 
cannot mimick fractals or sponges. However, in all three scenarios (compact, fractal, or spongy 
droplets), we are still left with the main question of this paper, namely whether 9g = 9i. In 
what follows, we shall present our arguments for 9g ^ 9i. If necessary, the reader may assume 
that droplets are compact, but in fact any scenario for droplets can be assumed without 
affecting our arguments. 

Motivating 9g ^ 9i. - We begin with a class of finite size clusters that are not of minimal 
energy (not droplets); they are only of relatively low energy. To make these clusters tangible, 
we think of constructing them by a stochastic algorithm. The details of such an algorithm 
are not an important issue here. Rather our goal is to understand by simple reasonings the 
qualitative topological features of the clusters that will be generated. 

The algorithm starts with the ground state configuration of spins. Suppose a seed site 
is given from which we build a connected cluster by stochastically adding neighboring sites 
which seem promising. For specificity, one can imagine that one adds the sites to the cluster 
irreversibly and in a near-greedy fashion where only spins leading to the lowest instantaneous 
energies are likely to be iteratively added. What kind of clusters emerge from this construction? 
Certainly these clusters must have a high connectivity, meaning that for each site of the cluster, 
a significant fraction of its neighbors on the cubic lattice are also part of the cluster. This 
property should hold if the distribution of Jij is not too broad because generally one has to 
flip more than one neighbor of a spin to change the sign of its local field. A low energy cluster 
will thus avoid stringy or one-dimensional parts. (If on the contrary the distribution of the Jy 



is broad, the clusters look rather like percolating clusters 14 .) Furthermore, since a majority 
of the bonds are satisfied in the ground state (recall that the ground state energy density is 
negative), nearby sites will tend to all join (or all not join) the cluster. In other words, the 
algorithm leads to a "cohesive" length ic (c for cohesion) below which the clusters are compact. 
Beyond the length scale £c, the growth process might follow that of the Eden model, leading to 
rough but compact clusters. However, it is possible to have a different scenario where beyond 
ic the interface of the growing cluster is unstable to branching and to the proliferation of 
handles. The resulting clusters then probably resemble sponges, with both a cluster and its 
complement being multi-connected. One may define a posteriori the scale £c for such an object 
as the inverse of its surface to volume ratio, or more physically from the peak in the sponges' 
structure factor. Qualitatively, ic can be considered to be the typical diameter a sphere of 
spins can grow to before it hits the surface of the sponge. 

The characteristic energies of these clusters should grow significantly faster than that of 
droplets. However, we expect most of the excess energy of a cluster to come from the "active" 
sites that will see their environment change if the growth process is continued; these sites have 
extra unsatisfied bonds that will become satisfied later on during the growth. We shall thus 
think of the moving surface or "outside" boundary of the cluster as concentrating most of the 
excess energy. (Note that by construction our growth rule is irreversible). 

Overall, we then view our cluster growth process as generating an expanding sponge with 
a multitude of handles beyond the length scale £c, leaving behind a low energy "inside" ; if the 
algorithm is smart enough, there is reason to believe that the energy density of this inside will 
be the same as that of the ground state. 

Now we want to extrapolate from finite size clusters to system-size clusters. We continue 
to grow our sponge-like clusters but now we take into account the fact that we work on a 
finite L X L X L lattice. As one increases the size of a sponge, its "outside" surface increases, 
but only until the sponge reaches a diameter of about L. After that, the number of bonds 
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which are unsatisfied will decrease because one can push the sponge's outside surface out of 
the system. Suppose for instance that one has free boundary conditions. When the growing 
interface reaches the edge of the lattice, it "falls off" : there are no bonds there to connect the 
inside of the cluster to its complement. (For a trivial example, consider the compact cluster 
which will grow to flip all the spins of the lattice; its energy goes from L^' to zero as its 
interface goes to the edge of the system.) In the case of periodic boundary conditions, the 
same phenomenon occurs if the cluster touches itself by wrap-around. We argued above that 
most of a sponge's energy comes from its outside surface; if that component of the surface is 
eliminated, one obtains a cluster of small characteristic energy. 

Given this gedanken construction, we now suggest that the lowest excitations that flip a 
finite fraction of the L x L x L spins may be spongy and span the whole system; we shall refer 
to them as system-size clusters. Appealing to scaling arguments, their energies should scale as 
L^f . The new nature of these excitations (if they are sponges reaching the edge of the system) 
suggests that 6g ^ 6i. 

Structure of the energy landscape. - To go from the ground state to one of these low-lying 
sponge states, one has to grow its corresponding cluster; during the growth, the cluster will 
reach a maximum outside surface where its characteristic size is 0{L). Following the energy 
analysis for droplets, the associated energy barrier between the ground state and a system-size 
cluster should thus be at least 0{L^' ) and may be much more. This argument can be extended 
to the barriers separating these different low energy configurations from one another too. Our 
conclusion is then that the Edwards- Anderson (EA) spin glass has an energy landscape with 
many "valleys" separated by diverging energy barriers as L — > oo. The cluster of spins one 
must flip to go from one of our valleys to another is sponge-like: both it and its complement 
span the whole lattice. The valleys should be similar microscopically, that is any finite size 
window will not permit one to distinguish the true ground state from one of these excited 
states. The reason is that ground states in spin glasses are sensitive to changes in the coupling 
constants; if we perturb a finite fraction of the JijS even far away, the ground state should 
change chaotically. Then the insides of the low lying sponges are equally good candidates for 
the new ground state, and all should be statistically similar; in particular, they should have 
the same energy density in the large volume limit. At finite temperature, one can expect these 
valleys to give rise to a multitude of states (if 6g > 0, it is more appropriate to call them 
metastable states). Because of the diverging energy barriers, it will be nearly impossible to 
equilibrate any lattice of size L x L x L as soon as L is large enough, and domain walls will 
"freeze-in" even if their density is not particularly low. 

RSB with sponges. - One of the key questions that discriminates between the droplet/scaling 
picture and the mean field picture is the value of 9g: it is implicitly assumed in the scaling 
picture that 9g = 9i > 0, whereas in the mean field picture, 6g — 0. If we assume that there 
exists constant energy sponge-like excitations and that 6'g = 0, we get a "real space" picture of 
the EA spin glass which is compatible with RSB. Indeed, with 6g = 0, sponge excitations give 
rise to a non-trivial overlap probability distribution. One can also look at window overlaps : 
for windows widths larger than the characteristic size of the handles in the sponges, one should 
see a non-trivial overlap distribution there too. Similarly, one can look at the energy overlap 
probability distribution; since the sponges are expected to have a finite surface to volume ratio 
in the large L limit, this kind of overlap also gives a non-trivial signal of RSB. Finally, within 
each valley, the exponent 9i continues to describe the size dependence of a droplet 's energy 
and thus determines the decrease of the spin-spin correlation function. 

Periodic-anti-periodic boundary conditions revisited. - If there are sponge-like system-size 
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excitations, their characteristic energies cannot be measured by comparing periodic to anti- 
periodic boundary conditions. The reason is that such boundary conditions do not couple 
to topologicaUy non-trivial excitations. As a result, even if 9dw > 0, one cannot exclude the 
presence of system-size excitations of constant energy, i.e., 9g — 0. Of course, in the case of 
the EA model in two dimensions, there are no handles or sponges, so it is possible that the 
droplet picture gives a correct description of the system on all scales and that 9g = 9i. 

To probe topologicaUy unconstrained low energy excitations in three dimensional spin 
glasses, one has to develop other methods. The main work in this direction is due to Palassini 



and Young |16, 1^. They consider the effect on the ground state of randomly changing some of 
the bonds at the boundaries. Their data for window overlaps far from these boundaries show 
a power law behavior in L, tending towards a trivial overlap function in the large L limit. If 
this extrapolation is correct, then the mean field picture is wrong. To sustain the mean field 
picture, one would have to claim that the power law behavior seen by Palassini and Young is 
only a transient, and that for "sufficiently" large L the non-trivial overlaps no longer decrease 
but survive with a finite (non-zero) amplitude. Only in this case, with 9g — 0, can one expect 
sponge-like excitations to appear upon changing a finite number of bonds. Indeed, if 9g > 0, 
droplet excitations couple to the changes in bond values, but sponges will not as L ~f oo. 

There is also a direct way to test numerically for the necessity to go beyond periodic vs. 
anti-periodic boundary conditions. Suppose one can extract the lowest energy excited state 
subject to the constraint of having an overlap with the ground state that is smaller than some 
fixed value (say 0.5). Our first claim is that the characteristic scale of this excitation energy is 
L^n with 9g < 9i. Our second claim is that the cluster of spins associated with the excitation 
will have a sponge- like non-trivial topology. The main obstacle impeding this kind of numerical 
test of our picture is the problem of finding excited states. The only truely reliable way to 
find these states is by a branch and bound algorithm as was done for the minimum matching 
problem [T^ . At present, branch and bound algorithms for spin glasses cannot treat systems 
larger than L = 5, so it is important to improve significantly the algorithmic tools currently 
available. 



Discussion and conclusions. - To arrive at our picture, we used a cluster growth gedanken 
algorithm. It is possible to use other ways to guess at the nature of system-size excitations. 
Imagine searching for the lowest energy excitation that flips a finite fraction of the spins on the 
lattice. There will be an interface separating the spins that are flipped from those that are not. 
An initial guess is that the interface corresponds to a rough domain wall. This is what happens 
if there is a non-zero surface tension. For our spin glass system where in the ground state a 
majority of the bonds are satisfied, a typical surface indeed has a positive surface tension. 
But optimised domain wall energies (as measured for instance using periodic vs. anti-periodic 
boundary conditions) teach us that the effective surface tension of an interface is zero if it is 
allowed to distort and take advantage of the unsatisfied bonds in the ground state. (Note that 
in our system a surface energy can have a negative value as long as it does not separate an 
inside from an outside.) With a zero surface tension, clearly the interface separating the flipped 
and not flipped spins will take advantage of topological freedoms, so handles will permeate 
through the whole system. This leads directly to a picture of sponge-like excitations. There 
is an analogue of this in systems without disorder, e.g., in microemulsions of two fluids whose 
interfacial tension is zero. This leads to bi-continuous phases (see and references therein), 
structures that are often called sponges. 

Yet another way to guess at the nature of system-size excitations is obtained if we require 
mean field to be relevant in finite dimensions. Since excitations in mean field models cannot 
have surface to volume ratios going to zero in the large volume limit, we are forced to consider 
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excitations in finite dimensional spin glasses which also have this property, and this leads one 
quite directly to sponge structures. 

We hope to have convinced the reader that sponge-like system-size excitations are likely 
to be relevant structures in the energy landscape of short range spin glasses. The picture 
that then follows is one where the droplet model is probably valid at any fixed length scale 
whereas a different picture (perhaps mean-field-like) gives the correct description of system-size 
excitations. It would be useful to deepen our geometrical picture in several ways. An important 
problem is to justify quantitatively 9g < 0i. Furthermore, taking mean field as a guide, 
under what conditions might the lowest valleys associated with sponges be equilibrium states 
with excess (free) energies of 0(1) rather than metastable states with diverging excess (free) 
energies? 
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